MICROPROCESSOR WITH EXECUTION PACKET 
SPANNING TWO OR MORE FETCH PACKETS 

Laurence Simar 
Richard A. Brown 



NOTICE 



10 



(C) Copyright 2000 Texas Instruments Incorporated. A portion of the 
disclosure of this patent document contains material which is subject to 
copyright protection. The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent disclosure, as it appears in the Patent 
15 and Trademark Office patent file or records, but otherwise reserves all 
copyright rights whatsoever. 



C b^^> ^s application claims priority under 35 USC §119(e)(l) of Provisional 
/^Application No. 60/165,512, filed November 15, 1999 (TI-29909PS), of 
20 Provisional Application No. 60/183,527, filed February 18, 2000 (TI- 
30302PS), andW Provisional Application No. 60/183,609, filed February 18, 
2000 (TI-30559P&). 



Technical Field of the Invention 

This invention relates to data processing devices, electronic processing 
and control systems and methods of their manufacture and operation, and 
particularly relates to memory access schemes of microprocessors optimized 
for digital signal processing. 
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Background of the Invention 



Generally, a microprocessor is a circuit that combines the instruction- 
handling, arithmetic, and logical operations of a computer on a single 
semiconductor integrated circuit. Microprocessors can be grouped into two 
general classes, namely general-purpose microprocessors and special-purpose 
microprocessors. General-purpose microprocessors are designed to be 
programmable by the user to perform any of a wide range of tasks, and are 
therefore often used as the central processing unit (CPU) in equipment such 
as personal computers. Special-purpose microprocessors, in contrast, are 
designed to provide performance improvement for specific predetermined 
arithmetic and logical functions for which the user intends to use the 
microprocessor. By knowing the primary function of the microprocessor, the 
designer can structure the microprocessor architecture in such a manner that 
the performance of the specific function by the special-purpose microprocessor 
greatly exceeds the performance of the same function by a general-purpose 
microprocessor regardless of the program implemented by the user. 

One such function that can be performed by a special-purpose 
microprocessor at a greatly improved rate is digital signal processing. Digital 
signal processing generally involves the representation, transmission, and 
manipulation of signals, using numerical techniques and a type of special- 
purpose microprocessor known as a digital signal processor (DSP). Digital 
signal processing typically requires the manipulation of large volumes of 
data, and a digital signal processor is optimized to efficiently perform the 
intensive computation and memory access operations associated with this 
data manipulation. For example, computations for performing Fast Fourier 
Transforms (FFTs) and for implementing digital filters consist to a large 
degree of repetitive operations such as multiply-and-add and multiple-bit- 
shift. DSPs can be specifically adapted for these repetitive functions, and 
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provide a substantial performance improvement over general-purpose 
microprocessors in, for example, real-time applications such as image and 
speech processing. 

DSPs are central to the operation of many of today's electronic 
products, such as high-speed modems, high-density disk drives, digital 
cellular phones, complex automotive systems, and video-conferencing 
equipment. DSPs will enable a wide variety of other digital systems in the 
future, such as video-phones, network processing, natural speech interfaces, 
and ultra-high speed modems. The demands placed upon DSPs in these and 
other applications continue to grow as consumers seek increased performance 
from their digital products, and as the convergence of the communications, 
computer and consumer industries creates completely new digital products. 

Microprocessor designers have increasingly endeavored to exploit 
parallelism to improve performance. One parallel architecture that has found 
application in some modern microprocessors utilizes instruction fetch packets 
and multiple instruction execution packets with multiple functional units, 
referred to as a Very Long Instruction Word (VLIW) architecture. 

Digital systems designed on a single integrated circuit are referred to 
as an application specific integrated circuit (ASIC). MegaModules are being 
used in the design of ASICs to create complex digital systems a single chip. 
(MegaModule is a trademark of Texas Instruments Incorporated.) Types of 
MegaModules include SRAMs, FIFOs, register files, RAMs, ROMs, universal 
asynchronous receiver-transmitters (UARTs), programmable logic arrays and 
other such logic circuits. MegaModules are usually defined as integrated 
circuit modules of at least 500 gates in complexity and having a complex 
ASIC macro function. These MegaModules are predesigned and stored in an 
ASIC design library. The MegaModules can then be selected by a designer 
and placed within a certain area on a new IC chip. 
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Designers have succeeded in increasing the performance of DSPs, and 
microprocessors in general, by increasing clock speeds, by removing data 
processing bottlenecks in circuit architecture, by incorporating multiple 
execution units on a single processor circuit, and by developing optimizing 
compilers that schedule operations to be executed by the processor in an 
efficient manner. However, execution packets in VLIW architectures must be 
aligned within a single instruction fetch packet. 

The increasing demands of technology and the marketplace make 
desirable even further structural and process improvements in processing 
devices, application systems and methods of operation and manufacture. 

Summary of the Invention 

An illustrative embodiment of the present invention seeks to provide a 
microprocessor and a method for accessing memory by a microprocessor that 
improves digital signal processing performance. Aspects of the invention are 
specified in the claims. 

In an embodiment of the present invention, fetch packets contain a 
plurality of instruction words. Execution packets include a plurality of 
instruction words that can be executed in parallel by two or more execution 
units. An execution packet can span two or more fetch packets. 

In an embodiment of the present invention, there are no execute 
packet boundary restrictions, thereby eliminating a need to pad a fetch 
packet by adding unneeded NOP instructions. 
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Brief Description of the Drawings 

Other features and advantages of the present invention will become 
apparent by reference to the following detailed description when considered 
5 in conjunction with the accompanying drawings, in which: 

Figure 1 is a block diagram of a digital signal processor (DSP), showing 
components thereof pertinent to an embodiment of the present invention; 

Figure 2 is a block diagram of the functional units, data paths and 
register files of Figure 1; 
10 Figure 3 shows the basic format of a fetch packet of the DSP of Figure 

i; 

Q Figure 4A depicts a fetch packet of Figure 3 with fully serial p-bits; 

Figure 4B depicts a fetch packet of Figure 3 with fully parallel p-bits; 
Figure 4C depicts a fetch packet of Figure 3 with partially serial p- 



■a 

m 

W 15 bits; 

fy 

O Figure 5 depicts fetch packet n, which contains three execute packets, 

L, shown followed by six fetch packets n+1 through n+6, each with one 

execution packet containing 8 parallel instructions; 

Figure 6 is a block diagram of a prior art processor, illustrating how 
20 execution packets must be aligned within fetch packets; 

Figure 7A is another illustration of fetch packets and execution packets 
in the prior art processor of Figure 6; 

Figure 7B is an illustration of execution packets spanning fetch 
packets for the processor of Figure 1; 
25 Figure 8 is a block diagram of the processor of Figure 1, illustrating a 

sequence of execution packets spanning fetch packets; 

Figure 9 is a block diagram of a portion of the instruction fetch pipeline 
of the processor of Figure 1 that illustrates circuitry for dispatching an 
execution packet that spans two fetch packets; 
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Figure 10 is a block diagram of an alternative embodiment of the 
processor of Figure 1; and 

Figure 11 is a wireless telephone that embodies the present invention. 
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Detailed Description of Embodiments of the Invention 



Figure 1 is a block diagram of a microprocessor 1 which has an 
embodiment of the present invention. Microprocessor 1 is a VLIW digital 
signal processor ("DSP"). In the interest of clarity, Figure 1 only shows those 
portions of microprocessor 1 that are relevant to an understanding of an 
embodiment of the present invention. Details of general construction for 
DSPs are well known, and may be found readily elsewhere. For example, 
U.S. Patent 5,072,418 issued to Frederick Boutaud, et al, describes a DSP in 
detail and is incorporated herein by reference. U.S. Patent 5,329,471 issued 
to Gary Swoboda, et al, describes in detail how to test and emulate a DSP 
and is incorporated herein by reference. Details of portions of microprocessor 
1 relevant to an embodiment of the present invention are explained in 
sufficient detail hereinbelow, so as to enable one of ordinary skill in the 
microprocessor art to make and use the invention. 

microprocessor 1 there are shown a central processing unit (CPU) 
10, data mfemory 22, program memory 23, peripherals 60 and an external 
memory interfa^bssGEMIF) with a direct memory access (DMA) 61. CPU 10 
further has an instru&ion fetch/decode unit lOa-c , a plurality of execution 
units, including an arithmfe<ic and load/store unit Dl, a multiplier Ml, an 
ALU/shifter unit SI, an arithmefasslogic unit ("ALU") LI, a shared multi-port 
register file 20a from which data are^Kead and to which data are written. 
Decoded instructions are provided from theinstruction fetch/decode unit 10a- 
c to the functional units Dl, Ml, SI, and LI ovet^yarious sets of control lines 
which are not shown. Data are provided to/from tn^egister file 20a from/to 
to load/store units Dl over a first set of busses 32a, to multiplier Ml over a 
second set of busses 34a, to ALU/shifter unit SI over a third ssA of busses 36a 
and to ALU LI over a fourth set of busses 38a. Data are providechto/from the 
memory 22 from/to the load/store units Dl via a fifth set of busses 40\ Note 
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that the entire data path described above is duplicated with register file 20b 
and execution units D2, M2, S2, and L2. Instructions are fetched by fetch 
unit 10a from instruction memory 23 over a set of busses 41. Emulation 
circuitry 50 provides access t ) the internal operation of integrated circuit 1 
which can be controlled by an pxternal test/development system (XDS) 51. 

External test system 51 is representative of a variety of known test 
systems for debugging and emulating integrated circuits. One such system is 
described in U.S. Patent 5,535,331 which is incorporated herein by reference. 
Test circuitry 52 contains control registers and parallel signature analysis 
circuitry for testing integrated circuit 1. 

Note that the memory 22 and memory 23 are shown in Figure 1 to be a 
part of a microprocessor 1 integrated circuit, the extent of which is 
represented by the box 42. The memories 22-23 could just as well be external 
to the microprocessor 1 integrated circuit 42, or part of it could reside on the 
integrated circuit 42 and part of it be external to the integrated circuit 42. 
These are matters of design choice. Also, the particular selection and number 
of execution units are a matter of design choice, and are not critical to the 
invention. 

en microprocessor 1 is incorporated in a data processing system, 
additional memory or peripherals may be connected to microprocessor 1, as 
illustratedYn Figure 1. For example, Random Access Memory (RAM) 70, a 
Read Only Memory (ROM) 71 and a Disk 72 are shown connected via an 
external bus r3. Bus 73 is connected to the External Memory Interface 
(EMIF) which impart of functional block 61 within microprocessor 42. A 
Direct Memory Access (DMA) controller is also included within block 61. The 
DMA controller is generally used to move data between memory and 
peripherals within microprocessor 1 and memory and peripherals which are 
external to microprocesso\l. 
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A detailed description of various architectural features of the 
microprocessor on Figure 1 is provided in coassigned application S.N. 
09/012,813 (TI-253p) and is incorporated herein by reference. 

Figuri 2 is a block diagram of the execution units and register files of 
'the microprocessor of Figure 1 and shows a more detailed view of the buses 
connecting/ the various functional blocks. In this figure, all data busses are 
32 bits wide, unless otherwise noted. There are two general-purpose register 
files (A and B) in the processor's data paths. Each of these files contains 32 
32-bit registers (A0-A31 for file A and B0-B31 for file B). The general- 
10 purpose /registers can be used for data, data address pointers, or condition 
registers. Any number of reads of a given register can be performed in a 
O given cycle. 

\j The general-purpose register files support data ranging in size from 

O 

packed 8-bit data through 64-bit fixed-point data. Values larger than 32 bits, 
W 15 such as 40-bit long and 64-bit double word quantities, are stored in register 

p pairs, with the 32 LSBs of data placed in an even-numbered register and the 

y* remaining 8 or 32 MSBs in the next upper register (which is always an odd- 

Q numbered register). Packed data types store either four 8-bit values or two 

N; 16-bit values in a single 32-bit register. 

O 2 0 There are 32 valid register pairs for 40-bit and 64-bit data, as shown in 

Table 1. In assembly language syntax, a colon between the register names 
denotes the register pairs and the odd numbered register is specified first. 



TI-30559 - 9 



Table 1. 40-Bit/64-Bit Register Pairs 



Register Files 


A 


B 


A1:A0 


B1:B0 


A3:A2 


B3:B2 


A5:A4 


B5:B4 


A7:A6 


67:B6 


A9:A8 


B9:B8 


A11:A10 


B11:B10 


A13:A12 


B13:B12 


A15:A14 


B15:B14 


A17:A16 


B17:B16 


A19:A18 


B19:B18 


A21:A20 


B21:B20 


A23:A22 


B23:B22 


A25:A24 


B25:B24 


A27:A26 


B27:B26 


A29:A28 


B29:B28 


A31:A30 


B31:B30 



The eight functional units in processor 10's data paths can be divided 
into two groups of four; each functional unit in one data path is almost 
identical to the corresponding unit in the other data path. The functional 
units are described in Table 2. 

Besides being able to perform 32-bit data manipulations, processor 10 
also contains many 8-bit and 16-bit data instructions in the instruction set. 
For example, the MPYU4 instruction performs four 8x8 unsigned multiplies 
with a single instruction on an .M unit. The ADD4 instruction performs four 
8-bit additions with a single instruction on an ,L unit. 
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Table 2. Functional Units and Operations Performed 



Functional Unit Fixed-Point Operations 



.L unit (.LI, .L2) 32/40-bit arithmetic and compare operations 

32-bit logical operations 

Leftmost 1 or 0 counting for 32 bits 

Normalization count for 32 and 40 bits 

Byte shifts 

Data packing/unpacking 

5-bit constant generation 

Paired 16-bit arithmetic operations 
Quad 8-bit arithmetic operations 

Paired 16-bit min/max operations 
Quad 8-bit min/max operations 



.S unit (.SI, .S2) 32-bit arithmetic operations 

32/40-bit shifts and 32 -bit bit-field operations 

32-bit logical operations 

Branches 

Constant generation 

Register transfers to/from control register file (.S2 only) 

Byte shifts 

Data packing/unpacking 

Paired 16-bit compare operations 

Quad 8-bit compare operations 

Paired 16-bit shift operations 
Paired 16-bit saturated arithmetic operations 
Quad 8-bit saturated arithmetic operations 



,M unit (.Ml, ,M2) 16 x 16 multiply operations 

16 x 32 multiply operations 

Bit expansion 

Bit interleaving/de-interleaving 

Quad 8x8 multiply operations 

Paired 16 x 16 multiply operations 

Paired 16 x 16 multiply with add/subtract operations 
Quad 8x8 multiply with add operations 

Variable shift operations 

Rotation 

Galois Field Multiply 



.D unit (.Dl, -D2) 32-bit add, subtract, linear and circular address calculation 

Loads and stores with 5-bit constant offset 

Loads and stores with 15-bit constant offset (.D2 only) 

Load and store double words with 5-bit constant 

Load and store non-aligned words and double words 

5-bit constant generation 

32-bit logical operations 



Most data lines in the CPU support 32-bit operands, and some support 
long (40-bit) and double vrord (64-bit) operands. Each functional unit has its 
own 32-bit write port into aVeneral-purpose register file (Refer to Figure 2A). 
All units ending in 1 (for example, .LI) write to register file A and all units 
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ending in 2 write to register file B. Each functional unit has two 32-bit read 
ports for source operands srcl and src2. Four units (.LI, .L2, .SI, and .S2) 
have an extra 8-bit-wide p >rt for 40-bit long writes, as well as an 8-bit input 
for 40-bit long reads. Because each unit has its own 32-bit write port, when 
performing 32-bit operatic ns all eight units can be used in parallel every 
cycle. Since each multiplier can return up to a 64-bit result, two write ports 
are provided from the multipliers to the register file. 

Register File Cross Paths 

functional unit reads directly from and writes directly to the 
register file within its own data path. That is, the .LI, .SI, .Dl, and .Ml 
units write to register^Sl^A and the X2, ,S2, .D2, and .M2 units write to 
register file B. The register fileS^re connected to the opposite-side register 
file's functional units via the IX and 2Xcfr&§§paths. These cross paths allow 
functional units from one data path to access a^S&^it operand from the 
opposite side's register file. The IX cross path allows data patfTA^functional 
units to read their source from register file B. Similarly, the 2X cro^path 
allows data path B's functional units to read their source from register file A* 
eight of the functional units have access to the opposite side's 
register file viaa>i?Q§s path. The .Ml, .M2, .SI, .S2, .Dl and .D2 units' src2 
inputs are selectable betweeiT'th^cross path and the same side register file. 
In the case of the .LI and .L2 both srclS5As§rc2 inputs are also selectable 
between the cross path and the same-side register 

Only two cross paths, IX and 2X, exist in this embodiment of the 
architecture. Thus the limit is one source read from each data path's opposite 
register file per cycle, or a total of two cross-path source reads per cycle. 
Advantageously, multiple units on a side may read the same cross-path 
source simultaneously. Thus the cross path operand for one side may be used 
by any one, multiple or all the functional units on that side in an execute 



TI-30559 - 12 





packet. In the C62x/C67x, only one functional unit per data path, per execute 
packet could get an operand from the opposite register file. 

A delay clock cycle is introduced whenever an instruction attempts to 
read a register via a cross path that was updated in the previous cycle. This 
is known as a cross path stall. This stall is inserted automatically by the 
hardware; no NOP instruction is needed. It should be noted that no stall is 
introduced if the register being read is the destination for data loaded by a 
LDx instruction. 



Memory, Load and Store Paths 

Processor 10 supports double word loads and stores. There are four 32- 
bit paths for loading data for memory to the register file. For side A, LDla is 
the load path for the 32 LSBs; LDlb is the load path for the 32 MSBs. For 
side B, LD2a is the load path for the 32 LSBs; LD2b is the load path for the 
32 MSBs. There are also four 32-bit paths, for storing register values to 
memory from each register file. STla is the write path for the 32 LSBs on 
side A; STlb is the write path for the 32 MSBs for side A. For side B, ST2a is 
the write path for the 32 LSBs; ST2b is the write path for the 32 MSBs. 

Some of the ports for long and double word operands are shared 
between functional units. This places a constraint on which long or double 
word operations can be scheduled on a datapath in the same execute packet. 

Data Address Paths 

&»a^40a has an address bus DAI which is driven by mux 200a. This 
allows an addressge!tee^ted by either load/store unit Dl or D2 to provide a 
memory address for loads or stor&s^Qrregister file 20a. Data Bus LD1 loads 
data from an address in memory 22 speciS&iJjv address bus DAI to a 
register in load unit Dl. Unit Dl may manipulate the d^a^pre^qded prior to 
storing it in register file 20a. Likewise, data bus ST1 stores dafe^from 
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register file 20a to memory 22. Load/store unit Dl performs the following 
operations: 32-bit aid, subtract, linear and circular address calculations. 
Load/store unit D2 operates similarly to unit Dl, with the assistance of mux 
200b for selecting an address. 

The DAI and DA2 resources and their associated data paths are 
specified as Tl and T2 respectively. Tl consists of the DAI address path and 
the LDla, LDlb, STla and STlb data paths. Similarly, T2 consists of the 
DA2 address path and the LD2a, LD2b, ST2a and ST2b data paths. The Tl 
and T2 designations appear in functional unit fields for load and store 
instructions. 

For example, the following load instruction uses the .Dl unit to 
generate the address but is using the LD2a path resource from DA2 to place 
the data in the B register file. The use of the DA2 resource is indicated with 
the T2 designation. 

LDW .D1T2 *A0[3],B1 

? liable 3 defines the mapping between instructions and functional units 
for a set of basic instructions included in DSP 10 is described in U.S. Patent 
S.N. 09/012)813 (TI-25311, incorporated herein by reference). Table 4 defines 
a mapping beWeen instructions and functional units for a set of extended 
instructions in Vn embodiment of the present invention. A complete 

description of the extended instructions is provided in U.S. Patent S.N. 

(TI-30302) entitled "Microprocessor with Improved ISA," and is incorporated 
herein by reference. Alternative embodiments of the present invention may 
have different sets of insmictions and functional unit mapping. Table 3 and 
Table 4 are illustrative and^are not exhaustive or intended to limit various 
embodiments of the present indention. 
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Table 3. Instruction to Functional Unit Mapping of Basic Instructions 



P 

W 
hi 



.L Unit 


.M Unit 


.S Unit 


.D Unit 


ABS 


MPY 


ADD 


ADD 


ADD 


SMPY 


ADDK 


ADDA 


AND 




ADD2 


LD mem 


CMPEQ 




AND 


LD mem (15-bit offset) (D2 only) 


CMPGT 




B disp 


MV 


CMPGTU 




BIRP 


NEG 


CMPLT 




BNRP 


ST mem 


CMPLTU 




B reg 


ST mem (15-bit offset) (D2 only) 


LMBD 




CLR 


SUB 


MV 




EXT 


SUBA 


NEG 




EXTU 


ZERO 


NORM 




MVC 




NOT 




MV 




OR 




MVK 




SADD 




MVKH 




SAT 




NEG 




SSUB 




NOT 




SUB 




OR 




SUBC 




SET 




XOR 




SHL 




ZERO 




SHR 








SHRU 








SSHL 








STP (S2only) 








SUB 








SUB2 








XOR 








ZERO 





yy 
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Table 4. Instruction to Functional Unit Mapping of Extended Instructions 



.L unit 


.M unit 


.S unit 


.D unit 


ABS2 


AVG2 


ADD2 


ADD2 


ADD2 


AVGU4 


ADDKPC 


AND 


ADD4 


BITC4 


AND 


ANDN 


AND 


BITR 


ANDN 


LDDW 


ANDN 


DEAL 


BDEC 


LDNDW 


MAX2 


D0TP2 


BNOP 


LDNW 


MAXU4 


D0TPN2 


BPOS 


MVK 


MIN2 


D0TPNRSU2 


CMPEQ2 


OR 


MINU4 


D0TPNRUS2 
D0TPRSU2 
D0TPRUS2 


CMPEQ4 
CMPGT2 
CMPGTU4 


STDW 


MVK 


D0TPSU4 
D0TPUS4 


CMPLT2 


STNDW 


OR 


D0TPU4 


CMPLTU4 


STNW 


PACK2 


GMPY4 


MVK 


SUB2 


PACKH2 


MPY2 


OR 


YOP. 

AWA 


PAPKTT4 


MPYHT 


PAPTC9 




PACKHL2 


MPYHIR 

MPVTH 

IVlx I lli 

MPYTHR 


PACKH2 




PACKL4 


MPYIL 
MPYILR 
MPYLI 






PACKLH2 


MPYLIR 


PACKLH2 




SHLMB 


MPYSU4 
MPYUS4 


SADD2 




SHRMB 


MPYU4 


SADDU4 




SUB2 


MVD 


SADDSU2 
SADDUS2 




SUB4 


ROTL 


SHLMB 




SUBABS4 


SHFL 


SHR2 




SWAP2 


SMPY2 


SHRMB 




.L unit 


.M unit 


.S unit 


.D unit 


SWAP4 


SSHVL 


SHRU2 




UNPKHU4 


SSHVR 


SPACK2 




UNPKLU4 


XPND2 


SPACKU4 




XOR 


XPND4 


SUB2 








SWAP2 








UNPKHU4 








UNPKLU4 








XOR 





Instructions are always fetched eight at a time. This constitutes a 
fetch packet. The basic format of a fetch packet is shown in Figure 3. The 
execution grouping of the fetch packet is specified by the p-bit, bit zero, of 
each instruction. Fetch packets are 8-word aligned. 

The p-bit controls the parallel execution of instructions. The p-bits are 
scanned from left to right (lower to higher address). If the p-bit of instruction 



TI-30559 - 16 



i is 1, then instruction i +1 is to be executed in parallel with (in the same 
cycle as) instruction i. If the p-bit of instruction i is 0, then instruction i + 1 
is executed in the cycle after instruction i. All instructions executing in 
parallel constitute an execute packet. An execute packet in this embodiment 
can contain up to eight instructions. All instructions in an execute packet 
must use a unique functional unit. 

The following examples illustrate the conversion of a p-bit sequence 
into a cycle-by-cycle execution stream of instructions. There are three types 
of p-bit patterns for fetch packets. These three p-bit patterns result in the 
following execution sequences for the eight instructions: fully serial; fully 
parallel; or partially serial. These three sequences of execution are explained 
more fully below. 

The fully serial p-bit pattern depicted in Figure 4A results in this 
execution sequence is illustrated in Table 5. 

Table 5. Fully Serial p-bit Pattern Execution Sequence 



Cycle 


Instructions 


1 


A 


2 


B 


3 


C 


4 


D 


5 


E 


6 


F 


7 


G 


8 


H 



The eight instructions are executed sequentially. 

The fully parallel p-bit pattern depicted in Figure 4B results in this 
execution sequence is illustrated in Table 6. 
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Table 6. Fully Parallel p-bit Pattern Execution Sequence 



Cycle 








Instructions 








1 


A 


B 


C 


D E 


F 


G 


H 



All eight instructions are executed in parallel. 
5 The partially serial p-bit pattern depicted in Figure 4C results in this 

execution sequence is illustrated in Table 7. 



Table 7. Partially Serial p-bit Pattern Execution Sequence 



IebJ 

Q 

ry 



H> 15 

o 



20 



25 



Cycle 


Instructions 


1 


A 






2 


B 






3 


C 


D 


E 


4 


F 


G 


H 



Note that the instructions C, D, and E do not use any of the same functional units, cross 
paths, or other data path resources. This is also true for instructions F, G, and H. 



The | | characters signify that an instruction is to execute in parallel 
with the previous instruction. In the previous partially serial example, the 
code would be represented as this: 



instruction 


A 


instruction 


B 


instruction 


C 


instruction 


D 


instruction 


E 


instruction 


F 


instruction 


G 


instruction 


H 



If a branch into the middle of an execution packet occurs, all 
instructions at lower addresses are ignored. In the partially serial example, 
if a branch to the address containing instruction D occurs, then only D and E 
will execute. Even though instruction C is in the same execute packet, it is 
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ignored. Instructions A and B are also ignored because they are in earlier 
execute packets. 

No two instructions within the same execute packet can use the same 
resources. Also, no two instructions can write to the same register during the 
same cycle. The following describes each of the resources an instruction can 
use. 

Two instructions using the same functional unit cannot be issued in 
the same execute packet. 

The following execute packet is invalid in the present embodiment: 
ADD .SI AO, Al, A2 ; \ .SI is used for both instructions 
| | SHR .SI A3, 15, A4 ; / 

The following execute packet is valid in the present embodiment: 
ADD .LI AO, Al, A2 ; \ Two different functional units 
| | SHR .SI A3, 15, A4 ; / are used 

Unprotected pipeline 



jice the pipeline of the present embodiment is unprotected, certain 



code sequences that cause resource conflicts are invalid. An assembler with 
appropriate coofe^i sequence checking capabilities is used to screen out invalid 
code sequences. Several constraints related to the present embodiment are 
described below. Other constraints which may apply to the present 
embodiment are described in US Patent No. 6,112,298 (TI-24946), 
incorporated herein by referen$£. 

Pipeline Operation 

The DSP pipeline has several key features which improve performance, 
decrease cost, and simplify programming. They are: increased pipelining 
eliminates traditional architectural bottlenecks in program fetch, data access, 
and multiply operations; control of the pipeline is simplified by eliminating 




TI-30559 - 19 



pipeline interlocks; the pipeline can dispatch eight parallel instructions every 

cycle; parallel instructions proceed simultaneously through the same pipeline 

phases; sequential instructions proceed with the same relative pipeline phase 

difference; and load and store addresses appear on the CPU boundary during 

5 the same pipeline phase, eliminating read-after-write memory conflicts. 

A multi-stage memory pipeline is present for both data accesses and 

program fetches. This allows use of high-speed synchronous memories both 

on-chip and off-chip, and allows infinitely nestable zero-overhead looping with 

branches in parallel with other instructions. 

10 There are no internal interlocks in the execution cycles of the pipeline, 

so a new execute packet enters execution every CPU cycle. Therefore, the 

O number of CPU cycles for a particular algorithm with particular input data is 

Sj fixed. If during program execution, there are no memory stalls, the number 

u 

m 

hi 



n 



of CPU cycles equals the number of clock cycles for a program to execute. 



15 Performance can be inhibited only by stalls from the memory 

subsystems or interrupts. The reasons for memory stalls are determined by 
the memory architecture. To fully understand how to optimize a program for 
speed, the sequence of program fetch, data store, and data load requests the 
program makes, and how they might stall the CPU should be understood. 



n 2 0^^^^ IJhe pipeline operation, from a functional point of view, is based on 
CPU cycles. A CPU cycle is the period during which a particular execute 
packet is m a particular pipeline stage. CPU cycle boundaries always occur 
at clock cyc\e boundaries; however, memory stalls can cause CPU cycles to 
extend over multiple clock cycles. To understand the machine state at CPU 
25 cycle boundaries, one must be concerned only with the execution phases (El- 
E5) of the pipeline. The phases of the pipeline are shown in Figure 11 and 
described in Table 
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Table 8. Pipeline Phase Description 



Pipeline 


Pipeline Phase 


Symbol 


During This Phase 


Instruction 

Types 
Completed 


— 

Program 

Fetch 


— — 

Program Address 

Generate 




— — — ; — - : : — 

Address of the fetch packet is determined. 






Program Address 
Send 


PS 


Address of fetch packet is sent to memory. 






Program Wait 


PW 


Program memory access is performed. 






Program Data 
Receive 


PR 


Fetch packet is expected at CPU boundary. 




Program 
Decode 


Dispatch 


DP 


Next execute packet in fetch packet determined and 
sent to the appropriate functional units to be decoded. 






Decode 


DC 


Instructions are decoded at functional units. 




Execute 


Execute 1 


El 


For all instruction types, conditions for instructions are 
evaluated and operands read. 

Load and store instructions: address generation is 
computed and address modifications written to register 

filet 

Branch instructions: affects branch fetch packet in PG 
phase 1 

Single-cycle instructions: results are written to a 
register file ' 


Single- 
cycle 




Execute 2 


E2 


Load instructions: address is sent to memory' 

Store instructions and STP: address and data are sent 

to memoryt 

Single— cycle instructions that saturate results set the 
SAT bit in the Control Status Register (CSR) if 

saturation occurs. ' 

Multiply instructions: results are written to a register 
filet 


Stores 
STP 

Multiplies 




Execute 3 


E3 


Data memory accesses are performed. Any multiply 
instruction that saturates results sets the SAT bit in 

the Control Status Register (CSR) if saturation occurs, t 






Execute 4 


E4 


Load instructions: data is brought to CPU boundary' 






Execute 5 


E5 


Load instructions: data is loaded into register' 


Loads 



'This assumes that the conditions for the instructions are evaluated as true. If the condition is evaluated as false, 
the instruction will not write any results or have any pipeline operation after El. 



The pipeline operation of the instructions can be categorized into seven 
types shown in Table 9. The delay slots for each instruction type are listed in 
the second column. 
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Table 9. Delay Slot Summary 



Instruction Type 


Delay Slots 


Execute Stages Used 


Branch (The cycle when the target enters El) 


5 


El -branch target El 


Load (LD) (Incoming Data) 


4 


E1-E5 


Load (LD) (Address Modification) 


0 


El 


Multiply 


1 


E1-E2 


Single-cycle 


0 


El 


Store 


0 


El 


NOP (no execution pipeline operation) 






STP (no CPU internal results written) 







The execution of instructions can be defined in terms of delay slots 
(Table 9). A delay slot is a CPU cycle that occurs after the first execution 
phase (El) of an instruction in which results from the instruction are not 
available. For example, a multiply instruction has 1 delay slot, this means 
that there is 1 CPU cycle before another instruction can use the results from 
the multiply instruction. 

Single cycle instructions execute during the El phase of the pipeline. 
The operand is read, operation is performed and the results are written to a 
register all during El. These instructions have no delay slots. 

Multiply instructions complete their operations during the E2 phase of 
the pipeline. In the El phase, the operand is read and the multiply begins. 
In the E2 phase, the multiply finishes, and the result is written to the 
destination (dst) register. Multiply instructions have 1 delay slot. 

Load instructions have two results: data loaded from memory and 
address pointer modification. 

Data loads complete their operations during the E5 phase of the 
pipeline. In the El phase, the address of the data is computed. In the E2 
phase, the data address is sent to data memory. In the E3 phase, a memory 
read is performed. In the E4 stage, the data is received at the CPU core 
boundary. Finally, in the E5 phase, the data is loaded into a register. 
Because data is not written to the register until E5, these instructions have 4 
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delay slots. Because pointer results are written to the register in El, there 
are no delay slots associated with the address modification. 

Store instructions complete their operations during the E3 phase of the 
pipeline. In the El phase, the address of the data is computed. In the E2 
phase, the data address is sent to data memory. In the E3 phase, a memory 
write is performed. The address modification is performed in the El stage of 
the pipeline. Even though stores finish their execution in the E3 phase of the 
pipeline, they have no delay slots and follow the following rules ( i = cycle): 

1) When a load is executed before a store, the old value is loaded 
and the new value is stored. 

i LDW 
£+1 STW 

2) When a store is executed before a load, the new value is stored 
and the new value is loaded. 

i STW 
i+1 LDW 

3) When the instructions are in are in parallel, the old value is 
loaded and the new value is stored. 

i STW 
i+1 | | LDW 
Branch instructions execute during the El phase of the pipeline five 
'delay slots/CPU cycles after the branch instruction enters an initial El phase 
of the pipeline. Figure 12 shows the branch instruction phases. Figure 13 
shows theV)peration of the pipeline based on clock cycles and fetch packets. In 
Figure 13, t£ a branch is in fetch packet n, then the El phase of the branch is 
the PG phaAe of n+6. In cycle 7 n is in the El phase and n+6 is in the PG 
phase. Because the branch target is in PG on cycle 7, it will not reach El 
until cycle 13. Thus, it appears as if the branch takes six cycles to execute, or 
has five delay slVts. 
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In Figure 5, fetch packet n, which contains three execute packets, is 
shown followed by six fetch packets (n+1 through n+6), each with one 
execution packet (containing 8 parallel instructions). The first fetch packet 
(n) goes through the program fetch phases during cycles 1-4. During these 
cycles a program fetch phase is started for each of the following fetch packets. 

In cycle 5, the program dispatch (DP) phase, the CPU scans the p-bits 
and detects that there are three execute packets (k thru k+2) in fetch packet 
n. This forces the pipeline to stall, which allows the DP phase to start execute 
packets k+1 and k+2 in cycles 6 and 7. Once execute packet k+2 is ready to 
move on to the DC phase (cycle 8) the pipeline stall is released. 

The fetch packets n+1 through n+4 were all stalled so the CPU would 
have time to perform the DP phase for each of the three execute packets (k 
thru k+2) in fetch packet n. Fetch packet n+5 was also stalled in cycles 6 and 
7; it was not allowed to enter the PG phase until after the pipeline stall was 
released in cycle 8. The pipeline will continue as shown with fetch packets 
n+5 and n+6 until another fetch packet containing multiple execution packets 
enters the DP phase, or an interrupt occurs. 
^T^> Figure 6 is a block diagram illustrating a prior art processor 600 that 
Vr-equires exe*s^tion packets to be aligned within fetch packets. Prior art 
processor 600 is aVLIW RISC architecture that has an instruction execution 
pipeline that operates^^imilarly to processor 10 in aspects other than 
execution packet alignment/SFour fetch packets 611-613 are illustrated in 
Figure 6. These are each fetchechsequentially in response to program fetch 
circuitry in processor 600. Fetch packet 610 comprises an execution packet 
620 that has seven useful instructions 62u^€D-620(6) that can all be executed 
in parallel. The next execution packet 621 >s in fetch packet 611 and 
comprises instructions 621(0)-621(4). A third execution packet 622 comprises 
one useful instruction 622(0). Disadvantageously, a no-o^sration instruction 
(NOP) 620(7) must be included in execution packet 620 since execution 
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packets must be aligned within fetch packets. Similarly, NOP instructions 
622(14 and 622(2) are placed in execution packet 622 to cause alignment with 
fetch packet 611. NOP instructions 620(7), 622(1) and 622(2) waste storage 
resources in ph>€^ssor 600. Note that the last word of each fetch packet has 
the p-bit set to 0 to mftk^ite the end of an execute packet, such as instruction 
word 620(7) and 622(2), for exalt^le. 

Figure 7A is another illustration of fetch packets and execution packets 
in prior art processor 600 of Figure 6. If an execution packet did not fit 
evenly within a fetch packet, NOP instructions were inserted in the 
instruction stream to pad out the fetch packet. For example, in Figure 7A, 
execution packet E3 cannot fit in the four-word space directly after execution 
packet E2, therefore four NOP instructions are inserted in the instruction 
sequence to pad out the fetch packet. Disadvantageously, instruction storage 
resources are wasted and unexecutable NOP instructions are needlessly 
fetched. 

v B^gure 7B is an illustration of execution packets spanning fetch 
packets foK.the processor of Figure 1. Advantageously, in the present 
embodiment oi]£>i^)cessor 10, an execution packet can cross an eight-word 
fetch packet boundary>^hereby eliminating a need to add NOP instructions to 
pad fetch packets. For exaih^le, eight-word execution packet EP1 completely 
occupies fetch packet 700. Fom**^ord execution packet EP2 partially fills 
fetch packet 702. Six-word executioiispacket EP3 does not fit completely 
within fetch packet 702, however, the firstx^our words EP#(0)-EP3(3) are 
placed in fetch packet 702 and the last two word^^P3(4), EP3(5) are placed 
in fetch packet 704. Therefore, the last p-bit in a fetch^acket is not always 
set to 0 in processor 10. If the last p-bit of a fetch packeiis^not zero, then 
instruction fetch control circuitry in stage 10a (Figure 1) fetch^Ss^ second 
fetch packet and extracts instruction words until a p-bit set toX) is 
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encountered. This sebuence of instruction words is then ordered into a single 
execution packet, sucn as execution packet EP3, for example. 

Figrlre 8 is a block diagram of processor 10 of Figure 1, illustrating a 
sequence of execution packets spanning fetch packets 810-813, according to 
an aspect lof the present invention. For ease of comparison, the same 
program portion is illustrated here as in Figure 6. For example, execution 
packet 820 |comprises only the seven useful instructions 820(0)-820(6). The 
last instruction word 820(6) has the p-bit set to 0. Advantageously, the first 
word 821(0) of execution packet 821 is now placed in fetch packet 810. Note 
that the p-bit of instruction word 821(0) is set to 1 to indicate that execute 
packet 821 continues to the next fetch packet 811 where instruction words 
821(l)-821(4t> are located. Likewise, execution packet 824 spans fetch packets 
811 and 812J with instruction word 824(0) located in fetch packet 811 and 
instruction v^ords 824(l)-824(3) located in fetch packet 812. Execution packet 
ruction words 823(0)-823(l) is located within fetch packet 811. 
last word of the fetch packet now does not necessarily have the 
for example instruction words 821(0) and 824(0) both have their 
p-bit set to one indicating that their associated execution packet spans to the 
next fetch packet. 

Figure 9 is a block diagram of a portion of instruction fetch pipeline 
stages lOa-lOc of processor 10 of Figure 1 that illustrates circuitry for 
dispatching an execution packet that spans two fetch packets. An eight word 
fetch packet is received on instruction data bus 941 from an instruction 
memory/cache into a first latch stage 910. A second latch stage 911 receives 
the first fetch packet on the next clock cycle while a second fetch packet is 
received simultaneously into latch stage 910. Multiplexor set 920 has eight 
individually controlled multiplexors 920(0)-920(7) that each have a first input 
connected to receive a 32-bit instruction word from first latch stage 910 and a 
32-bit instruction word from second latch stage 911. Dispatch control 



823 with ins 
Note that the 
p-bit set to 0, 
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circuitry 921 monitors the p-bit associated with each of the eight instructions 
in latch stage 910 via p-bit signals 922. An execution packet within latch 
stage 910 is selected by appropriate controls signals 924 asserted by dispatch 
control circuitry 921 to multiplexor set 920 and is passed thereby to 
crosspoint circuitry 930 and on to the various decode circuitry associated with 
the execution units of processor 10, as illustrated in Figure 8. 

If a first execution packet does not entirely fill the first fetch packet, 
then the second execution packet is selected from second latch stage 911 on a 
following clock cycle. Dispatch control circuitry 921 monitors second stage p- 
bit signals 923 and asserts controls signals 924 appropriately to multiplexor 
set 920 to select the second execution packet from latch stage 911 and it is 
passed thereby to crosspoint circuitry 930 and on to the various 
decode/execution units of processor 10. 

If the second execute packet spans the first and second fetch packets, 
then a first portion of the second execute packet is selected from latch stage 
911 and a remaining portion is selected from latch stage 910. Dispatch 
control circuitry 921 monitors p-bit signals 922 and 923 and asserts control 
signals 924 appropriately so that multiplexor set 920 selects the first portion 
of the second execute packet from latch stage 911 and the remaining portion 
from latch stage 910. 

Thus, control circuitry 921 is connected to a plurality of instruction 
positions corresponding to the plurality of instructions of a fetch packet in latch 
stage 910 and latch stage 911 to determine a boundary of each execute packet. 
The control circuitry is operable to control selection circuitry 920 in response to 
an execute packet boundary. 

A sequence of instruction fetch packets is fetched, wherein each fetch 
packet contains a first plurality of instructions. Each fetch packet is 
examined to determine an execution packet boundary and then a first portion 
of an execute packet is selected from a first fetch packet and a second portion 
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of a first execute packet from a second fetch packet if the first execute packet 
boundaries span the first fetch packet and the second fetch packet. 

Fetch pipe stalls are generated as needed, as discussed with reference 
to Figure 5, if latch stage 910 is not free when a fetch packet arrives on 
instruction bus 941. 

Figure 10 is a block diagram of an alternative embodiment of a digital 
system 1000 with processor core 1001 similar to processor core 10 of Figure 1. 
A direct mapped program cache 1010b 3 having 16 kbytes capacity, is 
controlled by LI Program (LIP) controller 1010a and connected thereby to 
the instruction fetch stage 10a. A 2-way set associative data cache 1020b, 
having a 16 kbyte capacity, is controlled by LI Data (LID) controller 1020a 
and connected thereby to data units Dl and D2. An L2 memory/cache 1030 
having four banks of memory, 128 Kbytes total, is connected to LIP 1010a 
and to LID 1020a to provide storage for data and programs. External 
memory interface (EMIF) 1050 provides a 64-bit data path to external 
memory, not shown, which provides memory data to L2 memory 1030 via 
extended direct memory access (DMA) controller 1040. 

EMIF 1052 provides a 16-bit interface for access to external 
peripherals, not shown. Expansion bus 1070 provides host and I/O support 
similarly to host port 60/80 of Figure 1. 



ree multi-channel buffered serial ports (McBSP) 1060, 1062, 1064 



are connectecHoDMA controller 1040. A detailed description of a McBSP is 
provided in U.S. Pateitts^plication S.N. 09/055,011 (TI-26204, Seshan, et al) 
and is incorporated herein retei*fcaace. 

The Very Long Instruction Word (VLIW) CPU of the present invention 
uses a 256-bit wide instruction to feed up to eight 32-bit instructions to the 
eight functional units during every clock cycle. The VLIW architecture 
features controls by which all eight units do not have to be supplied with 
instructions if they are not ready to execute. The first bit of every 32-bit 
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instruction determines if the next instruction belongs to the same execute 
packet as previous instruction, or whether it should be executed in the 
following clock as a part of the next execute packet. While fetch packets are 
always 256-bit wide, execute packets can vary in size as shown with reference 
to Figures 4A-4C. Variable length execute packets are a key memory saving 
feature distinguishing CPU 1001 from other VLIW architectures. 

Advantageously, instruction fetch stage 10a and dispatch stage 10b are 
constructed according to Figure 9 such that an execution packet can span two 
fetch packets. Advantageously, NOP instructions are not needed to maintain 
execution packet alignment in processor 1001. 

Other systems 

Several example systems which can benefit from aspects of the present 
invention are described in U.S. Patent 5,072,418, which was incorporated by 
reference herein, particularly with reference to Figures 2-18 of U.S. Patent 
5,072,418. A microprocessor incorporating an aspect of the present invention 
to improve performance or reduce cost can be used to further improve the 
systems described in U.S. Patent 5,072,418. Such systems include, but are 
not limited to, industrial process controls, automotive vehicle systems, motor 
controls, robotic control systems, satellite telecommunication systems, echo 
canceling systems, modems, video imaging systems, speech recognition 
systems, vocoder-modem systems with encryption, and such. 
*y Figjire 11 illustrates an exemplary implementation of an example of an 
integrated circttit^40 that includes digital system 1000 in a mobile 
telecommunications devic&>Sjich as a wireless telephone with integrated 
keyboard 12 and display 14. As shown^m>Ei^ure 11 digital system 1000 with 
processor 1001 is connected to the keyboard 12^Wh^e appropriate via a 
keyboard adapter (not shown), to the display 14, where apjJrogriate via a 
display adapter (not shown) and to radio frequency (RF) circuitry 16. Tlfe^F 
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Circuitry 16 is connected to an aerial 18. Advantageously, by allowing execute 
pack^tSsto span fetch packets, memory is not wasted with useless NOP 
instructions. T^tTrs^-^^ can be included within the wireless 

telephone and fewer fetch cycles are reqmr§tS£^^ of a given 

processing algorithm and power consumption is thereby reduc&l. 

Fabrication 

Fabrication of digital system 10 or digital system 1000 involves 
multiple steps of implanting various amounts of impurities into a 
semiconductor substrate and diffusing the impurities to selected depths 
within the substrate to form transistor devices. Masks are formed to control 
the placement of the impurities. Multiple layers of conductive material and 
insulative material are deposited and etched to interconnect the various 
devices. These steps are performed in a clean room environment. 

A significant portion of the cost of producing the data processing device 
involves testing. While in wafer form, individual devices are biased to an 
operational state and probe tested for basic operational functionality. The 
wafer is then separated into individual dice which may be sold as bare die or 
packaged. After packaging, finished parts are biased into an operational 
state and tested for operational functionality. 

Thus, a digital system is provided with a processor having an improved 
instruction fetch and dispatch mechanism. Advantageously, by allowing 
execute packets to span fetch packets, memory is not wasted with useless 
NOP instructions. 

Advantageously, in some system a smaller memory may result from 
elimination of NOP instructions. 

Advantageously, fewer fetch cycles are required for execution of a given 
processing algorithm since useless NOP instructions are not fetched. 
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In another embodiment, fetch packets may be longer or shorter than 
the present embodiments. For example, a fetch packet may be four 
instruction words. Likewise, instruction words may be other sizes than 32- 
bits. 

5 In another embodiment, there may be more or fewer execution units 

than eight. Likewise, the number of execution units may differ from the size 
of the fetch packet. For example, a processor may have an eight word fetch 
packet and have ten execution units, for example. In such an embodiment, 
an execution packet may exceed the length of a fetch packet and may 
10 therefore span more than two fetch packets. 

In another embodiment, a different form of dispatching circuitry may 
Q be provided to select an execution packet from two or more fetch packets. 

Sj As used herein, the terms "applied," "connected," and "connection" 

Q 

«i mean electrically connected, including where additional elements may be in 

W 15 the electrical connection path. "Associated" means a controlling relationship, 

Q such as a memory resource that is controlled by an associated port. The 

Lx terms assert, assertion, de-assert, de-assertion, negate and negation are used 

O 

:~ to avoid confusion when dealing with a mixture of active high and active low 

yy 

H; signals. Assert and assertion are used to indicate that a signal is rendered 

□ 20 active, or logically true. De-assert, de-assertion, negate, and negation are 
used to indicate that a signal is rendered inactive, or logically false. 

While the invention has been described with reference to illustrative 
embodiments, this description is not intended to be construed in a limiting 
sense. Various other embodiments of the invention will be apparent to 
25 persons skilled in the art upon reference to this description. It is therefore 
contemplated that the appended claims will cover any such modifications of 
the embodiments as fall within the true scope and spirit of the invention. 



TI-30559 - 31 



